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We introduce the concept of avoiding sets for investigating symbolic dynamics of discrete dynam- 
ical systems with time delays. Such sets arise from specific non-generating partitions of the phase 
space that restrict the occurrence of particular symbol sequences related to the characteristics of 
the dynamics. We use the theory in two applications to coupled map lattices, namely, determining 
unknown values of the transmission delays and detecting synchrony using measurements from a 
single node. 
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Symbolic dynamics is a fundamental tool for describ- 
ing the complicated time evolution of chaotic dynamical 
systems, the Smale horseshoe being a most famous proto- 
type In symbolic dynamics, instead of representing a 
trajectory by a continuum of numbers one watches the al- 
ternation of finite symbols. In the process some informa- 
tion is "lost" but certain important invariants and robust 
properties of the dynamics may be kept 2]. Most stud- 
ies of symbolic dynamics in the literature are based on 
the so-called generating partition [3i] of the phase space, 
for which topological entropy achieves its maximum 4]. 
Symbolic dynamics based on generating partitions plays 
a crucial role in understanding many different properties 
of dynamical systems. However, finding generating par- 
titions for general systems is a difficult problem and is an 
issue of ongoing research Q . Some consequences of using 
misplaced partitions have been investigated in |(|. Nev- 
ertheless, certain non-generating partitions have recently 
been shown to have particular uses. Specifically, appro- 
priately chosen partitions which restrict the appearance 
of some symbolic subsequences have been used for distin- 
guishing random from deterministic time series 0, and 
for investigating the collective behavior of coupled sys- 
tems |8]. In this paper, we use symbolic dynamics for 
the study of systems with time delays. The presence of 
time delays is a natural and important consequence of 
the finite speed of information transmission within a sys- 
tem or between coupled systems. However, the effects of 
delays on the symbolic dynamics have not received much 
attention so far. We develop an idea of restricted symbol 
subsequences for systems with delays, and present two 
applications of the method, namely detecting synchro- 
nization in a network using measurements from a single 
node and determining the unknown value of the delay in 
the system. 

We introduce the concepts starting with the simplest 
system and moving on to more complicated ones. Let 
/ : S" ^ be a map on a subset S of M", and consider 
the dynamical system defined by the iteration rule 



where the iteration step t G Z plays the role of dis- 
crete time. Let Si : i = 1, . . . ,to be a partition of S, 
i.e., a collection of mutually disjoint subsets satisfying 
U™i5'i = S. We assume that the Si are nonempty 
and m > 2 to prevent trivial cases. The symbolic dy- 
namics corresponding to ([T]) is the sequence of symbols 
{. . . , St-i, St,st+i, . . . } where St = z if x{t) G Si (shift of 
finite type We say the set 5'^ avoids Sj under / if 



f{s,) n s, = 0. 



(2) 



xit + l) = f{x{t)), 



(1) 



Clearly, if Si avoids Sj, so does any of its subsets. We also 
talk about a self-avoiding set if ([2]) holds with i = j. The 
significance of avoiding sets is that if Si avoids Sj, then 
the symbolic dynamics for ([1]) cannot contain the symbol 
sequence ij. The notion is extended in a straightforward 
way to the A:th iterate of /. Thus, if f''{Si)nSj = 0, then 
the symbol sequence for the dynamics cannot contain the 
symbols i and j at two positions which are k — I symbols 
apart. This constrains the symbol sequences that can be 
generated by a given map, and provides a robust method 
to distinguish between different systems by inspecting 
their symbolic dynamics. As examples of avoiding sets, 
we mention that for the common unimodal maps of the 
interval [0, 1], such as the tent or logistic maps, the set 
{x* , 1] and its subsets are self-avoiding, where x* denotes 
the positive fixed point of /. 

More generally, partitions that contain avoiding sets 
can always be found. We give a constructive proof. Sup- 
pose one starts with some partition of m sets for which ^ 
does not hold for any i,j. Now fix some pair (i,j), i ^ j- 
If f{Si) C Sj, then Si can be arbitrarily partitioned into 
two parts which avoid each other. If, on the other hand, 
f{Si) ^ Sj, then let Syn+i = f~'^{Sj) n Si, and re-define 
Si as S[ = Si\Sm+i to obtain a new partition with m + 1 
sets, where S'i avoids Sj. The same argument can be used 
to construct self-avoiding sets: Assume f{Si) (/_ Si (oth- 
erwise further partition Si to obtain a set which is not 
invariant under / [15|), and define Sm+i — f~^{Si) H Si 
and SI — Si\Sm+i, so that S*- is self-avoiding. Hence, it is 
possible to modify a given partition so that the sequence 
ij never occurs in the symbolic dynamics. 
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An extension of the system ([T]) is given by the delayed 
dynamics 



x{t + l) = {l-e)f{x{t))+ef{x{t-T)), 



(3) 



where r e Z+ is the time delay and e G [0, 1] is a pa- 
rameter measuring the relative weight of the past in de- 
termining the next state. The significance of the delayed 
dynamics ([3]) is that it governs the behavior of the syn- 
chronous solutions of coupled map networks with trans- 
mission delays which are studied below. The do- 
main S of the map / is required to be a convex set in 
order for the iterations ^ to be meaningful. The sym- 
bolic dynamics is defined as before, and avoiding sets give 
rise to forbidden sequences as follows: Let Sj denote the 
complement S\Sj, and suppose that Sj is convex. If 
f{Si) n Sj = 0, that is, if Si avoids Sj under /, then the 
symbolic sequence 



(4) 



is not possible for the delayed system ([3]) . (Here * ■ • ■ * 
denotes t — 1 arbitrary symbols.) This is a consequence 
of ^ and the observation that if f{x{t)) and f{x{t — t)) 
are both in the convex set Sj, so is their convex combi- 
nation. Similarly, if Si is self-avoiding under / and has 
convex complement, then any sequence of t + 1 symbols 
that begin and end with i cannot be followed by another 
i. The important observation is that, although the dy- 
namics of ([3]) varies greatly with e [10], the forbidden 
sequences (jH) are independent of the value of e. 

The additional condition of convexity of the sets in 
case of the delayed dynamics does not present an extra 
restriction in many practical situations. In fact, one often 
measures a single component, say the first one, of the n 
-dimensional vector x — {xi,...,Xn)- In this case, a 
simple partition of S given by the disjoint union 5* = 
Si U S'2 , where 



Si = 



e R" : a:i < x*} 



and X* is a scalar threshold value, which can be cho- 
sen to make both Si and S'2 nonempty. It is easy to 
see that both Si and S'2 defined in this way are convex 
whenever S is convex. Such partitions are almost surely 
non-generating, so the corresponding symbol sequences 
do not capture all features of the dynamics. However, 
it will be seen that they still contain important informa- 
tion that can be utilized to study some important aspects 
about the delayed dynamics. 

A more complicated system is the coupled map lat- 
tice model 0. We consider a more general form which 
allows arbitrary coupling topologies, including directed 
and/or weighted connections, as well as the information 



transmission delays along the connections: 

N 

x,{t+l) = f{x.{t)) + f 5]a,, [f{x,{t - t)) - f{xM)] ■ 

(5) 

Here Xi{t) is the state of the ith unit at time t, i — 
1, . . . , N, aij is the nonnegative weight on the link from 
j to i (zero if there is no fink), e £ [0, 1] is the coupfing 
strength, and ki = J^j o-ij the weighted sum of the 
incoming links to unit i. (It is understood that the sum- 
mation term is set to zero in ([S|) for any unit for which ki 
is zero.) The delay r is the time it takes for the informa- 
tion from a unit to reach its neighbors and be processed. 
The system is said to synchronize if \xi{t) — Xj{t)\ — > 
as i — > 00 for all i,j and all initial conditions from an 
open set. In this case, the state of every node asymp- 
totically approaches the same synchronous solution x(t), 
whose dynamics is governed by ([T]) and ([3]), respectively, 
depending on whether the delay r is zero or nonzero. 
It has been shown that the network ([5]) can synchronize 
even with positive delays, where the units are unaware 
of the present states of their neighbors but still can act 
in unison [lo| . The important distinction from the un- 
delayed case, however, is that the synchronous dynamics 
x{t) is no longer identical to the isolated dynamics ^ 
of the units, but is governed by the delayed equation 
([3]). Consequently, the overall system (O can exhibit a 
much wider range of behavior than its constituent units 
through the coordination of their actions H | . 

Normally the symbol sequences observed from a node 
of a network can vary widely between the nodes. How- 
ever, at the synchronized state Xi{t) = x{t) for all i, 
so that the symbolic sequences observed from any node 
will be subject to the same constraints as that gener- 
ated by ^ This gives a method of detecting syn- 
chronization of the network by choosing an arbitrary 
node and calculating the transition probabilities of sym- 
bol subsequences: From the relative frequencies of oc- 
currence of subsequences of the form (|4]) in the mea- 
sured time series, one estimates the transition probabili- 
ties P{i\{i*- ■ ■*i)r+i), that is, the conditional probability 
that a sequence of length r + 1 starting and ending with 
i is followed by j. Letting denote the average squared 
difference between the observed transition probabilities 
of the network and those of ([3]), synchronization is sig- 
naled when — 0. 

Fig.[T]illustrates the synchronization detection method 
for several different networks and delay values. Here / is 
the chaotic tent map given by f{x) = 1 ^ 2\x ^ ^\ and 
the partition used is 



Si = [0,a;*], S2 = (x*,l], 



(6) 



where x* — 2/3 is the fixed point of the map. Then 
S2 is a self- avoiding set under /. We evolve ([5]) starting 
from random initial conditions and estimate the transi- 
tion probabilities using time series of length 1000 from 
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FIG. 1: Detecting network synchrony by comparing the transition probabihties from measurements at a single node with those 
of the synchronous solution ([Sjl. Average deviations in transition probabilities are plotted against the coupling strength e. 
The synchronous regime where rj^ — Q coincides with the regions where = 0. The plots (a)-(d) are for a globally coupled 
network of size 20, and delay values (a) r = 0, (b) t = 1, (c) r = 2, (d) r = 3. (e) and (f) are plotted, respectively, for a 
random network of size 100 and scale-free network of size 200, where r = 3 for both, (g) and (h) are for the same network and 
delay as in (d), but with additive noise of 2% and 5%, respectively, in the measurements. 



a randomly selected node. Note that the length of the 
time series is much shorter time than would be required 
by standard time-series methods which use embedding 
to reconstruct the phase space [12|, |l3| for large net- 
works. In our case, however, the length of the series is 
independent of the network size. Synchronization occurs 
when the variance of variables over the network given 

by cr^ = {^jfZiYliA^ii'^) drops to zero, where 

x{t) — '^iXi{t) denotes an average over the nodes of 
the network and {■ ■ ■)i denotes an average over time. As 
seen from Fig. [1] the region for synchronization exactly 
coincides with the region where the transition probabil- 
ities for the network are identical to those of the equa- 
tion Q. Hence, regardless of network topology and size, 
both synchronized and unsynchronizcd behavior of the 
network can be accurately detected over the whole range 
of coupling strengths using only measurements from an 
arbitrarily selected node. 

As a second application, we consider the reverse prob- 
lem of determining the value of the delay r in ([3|) from 
observed symbolic dynamics. For this purpose, we check 
the presence of symbolic subsequences of the form ^ of 
various lengths, knowing that such a sequence of length 
T+2 would be forbidden. We plot the occurrence frequen- 
cies of (HI against t, and the point where the frequency 
is zero corresponds to the true value of t. (If the obser- 
vations are contaminated by some small noise, then the 
true value of r is found at the minimum of the curve.) 



The same method works to find the value of the trans- 
mission delay in the network ([S]) from a knowledge of its 
synchrony. One can think of a situation where the value 
of T is unknown, but the network is known to be synchro- 
nized or can be made to synchronize by the adjustment 
of available parameters. Then, using the measurements 
from a node and checking the presence of the forbidden 
sequences dU as before, the value of t can be obtained. 
An illustration is given in Fig.[2]for the tent map and the 
two-set partition ([S]), which plots the transition probabil- 
ity P(2|(2 * ■ • • * 2)t+i) versus r, that is, the conditional 
probability that a sequence of length t + 1 starting and 
ending with 2 is followed by another 2. By the arguments 
following Q, such a sequence cannot occur for the dy- 
namics (O since ^2 is self-avoiding under /. Hence, the 
true value of r is found at the point where the transition 
probability of the forbidden sequence drops to zero. 

The foregoing ideas can be extended to systems with 
multiple delays, e.g., to the coupled map network 



N 



(7) 

where denotes the transmission delay from j to i. 
While the network ([5]) with a constant delay always ad- 
mits a synchronous solution, one needs additional condi- 
tions in the case (O of multiple delays. It can be shown 
that ([7]) admits non-constant synchronized solutions pro- 
vided that each unit has the same fraction of weighted 
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FIG. 2: Detection of delay in a synchronized network using 
time series measured from an arbitrarily selected node. The 
transition probability P(2|(2 * • ■ • * 2)r+i) is plotted against 
r. The true value of r corresponds to the point where the 
probability drops to zero. The figure is plotted for globally 
coupled networks of 20 nodes with e — 0.75, where the true 
value of the delay is (a) 5 and (b) 6. The dotted lines show 
the results in the presence of 5% additive noise. 



incoming connections having the same delay. In this case, 
it is possible to have a synchronous solution of the form 
Xi{t) = x{t) for all i, and 



x{t + l) 



m=0 



^f{x{t - m)), 



(8) 



where Tmax is the maximum delay in the system, and 
the coefficients £m are nonnegative numbers satisfying 
X]n"=o £"1 = 1- Since the right hand side of ^ hes in the 
convex hull of the set {f{x{t — m)) : m — . . . , Tmax}, it 
belongs to any convex set containing the latter. It follows 
that if Sj is convex and Si avoids Sj under /, then the 
symbolic sequence 

(9) 



is not possible for ([8]); that is, a sequence of consecutive 
i's of length (rmax + 1) cannot be followed by a j. Note 
that this result is independent of the values of the EmS. 
Further restrictions are obtained if some Sm is zero, in 
which case the sequence ([9]) will be forbidden even when 
the symbol at position (r^ax + 1 — m) is replaced by an 
arbitrary symbol in the alphabet. As before, synchro- 
nization of the network can be detected by comparing 
the transition probabilities of symbolic sequences from 
an arbitrary node to those of ([8]). Similarly, the unknown 
values of the delays in ([8]) can be determined by system- 
atically checking for the presence of sequences of various 
lengths that start with the symbol i and end with j . By 
the same procedure, the unknown delays in the network 
([7]) can be calculated from a knowledge of its synchrony. 

In conclusion, we have used symbolic dynamics to 
study discrete-time systems and networks involving time 
delays. We have derived forbidden symbol sequences for 
the delayed system from the properties of the undelayed 
map. Although the partitions used are non-generating. 



the forbidden sequences are related to certain character- 
istics of the dynamics, and in particular to delays. Con- 
sequently, the value of the delay in the system can be de- 
termined by the presence and absence of such sequences. 
Conversely, a knowledge of the delays enables one to de- 
tect network synchronization using measurements from 
a single node. Computationally, the method has the ad- 
vantage of being based on a phase-space partition that is 
much easier to obtain than a generating partition. Fur- 
thermore, based on measurements from as few as one sin- 
gle node of the network, rather short sequences of mea- 
surements can be utilized. The corresponding computa- 
tions are fast and independent of the network size, and 
do not require knowledge of the connection structure. As 
such, the method can be a viable alternative to existing 
techniques for detecting synchronization based on phase- 
space reconstruction [14|. 

Discrete-time systems are a natural way to model dy- 
namics from temporal measurements because of the na- 
ture of collected data, and the inclusion of time delays 
additionally enhances the models by enlarging the range 
of dynamics using only a few scalar parameters [lo| . For 
models of the form ([3]) or ([5]) , the knowledge of forbidden 
sequences provides an easy method to determine the ad- 
missible values of delays from measurement data. Sym- 
bolic dynamics therefore holds the promise of being a 
useful tool in the study of time series as well as time- 
delay systems and networks. 
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